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Abstract 

We consider two-node queue with finite buffers modeled as a two-dimensional 
random walk on a finite state space. We develop an approximation scheme 
based on the Markov reward approach to error bounds in order to bound 
performance measures of a two-dimensional finite random walk in terms of a 
perturbed random walk in which only the transitions along the boundaries 
are different from those in the original model. The invariant measure of the 
perturbed random walk is of product-form. We first apply this approxima¬ 
tion scheme to a tandem queue with finite buffers and some variants of this 
model. Then, we show that our approximation scheme is sufficiently general 
by applying it to a coupled-queue with finite buffers and processor sharing. 

Keywords: Random walk, Finite state space, Product-form, Error bounds, 
Performance measure 


The two-node queue with a finite buffer space is one of the most exten¬ 
sively studied topics in queueing theory. Finite capacity buffers are usually 
used to model stochastic systems with limited storage capacity such as manu¬ 
facturing, telecommunications or transportation applications. The two-node 
queue with a finite buffer space is often modeled as a two-dimensional ran¬ 
dom walk on a finite state space. Hence, it is sufficient to find performance 
measures of the corresponding two-dimensional random walk on a finite state 
space if we are interested in the performance of the two-node queue with a 
finite buffer space. 
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A special case of the two-node queue with a finite buffers space, which 
has been extensively studied so far, is the tandem queue with a finite buffer 
space. An extensive list of papers on this topic is provided in ehu. Most 
of these papers focus on the development of approximations or algorithmic 
procedures to find steady-state system performances such as throughput and 
the average number of customers in the system. A popular approach used 
in such approximations is decomposition, see [1, 6J. The main variations of 
such a model are: three or more stations in the tandem queue ra. multiple 
servers at each station [20] [22], optimal design for allocating finite buffers to 
the stations [Sj, general service time pE3l 13; etc. Numerical results of such 
approximations often imply that the proposed approximations are indeed the 
bounds of the specific performance measure. However, these approximation 
methods cannot be easily extended to a general method, which determines 
the steady-state performance measures of any two-node queue with finite 
buffers. 

Van Dijk et ah HU pioneered in developing error bounds for the system 
throughput using the product-form modification approach. The method has 
since been further developed by van Dijk et al. [T5] [19] and has been applied 
to, for instance, Erlang loss networks [3], to networks with breakdowns 
to queueing networks with non-exponential service [18] and to wireless com¬ 
munication networks with network coding [7], An extensive description and 
overview of various applications of this method can be found in [UJ. 

A major disadvantage of the error bound method mentioned above is that 
the verification steps that are required to apply the method can be techni¬ 
cally quite complicated. Goseling et ah [8] developed a general verification 
technique for random walks in the quarter-plane. This verification technique 
is based on formulating the application of the error bounds method as solving 
a linear program. In doing so, it avoids completely the induction proof re¬ 
quired in [19]. Moreover, instead of only bounding performance measures for 
specific queueing system, the approximation method developed in [8] accepts 
any random walk in the quarter-plane as an input. 

The main contribution of the current work is to provide an approximation 
scheme which can be readily applied to approximate performance measures 
for any two-node queue with finite buffers. This is based on modifying the 
general verification technique developed in |8J for a two-dimensional random 
walk on a finite state space. 

We apply this approximation scheme to a tandem queue with finite buffers. 
We show that the error bounds for the blocking probability are improved com- 
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pared with the error bounds for the blocking probability provided in |T7j. The 
method in H3 is based on specific model modification. Apart from this, our 
approximation scheme is more general in the sense that other interesting 
performance measures could also be obtained easily. This is an advantage 
over the methods used in m\n\m where different model modifications are 
necessary for different performance measures. Moreover, we show that the 
error bounds can still be achieved for variations of the tandem queue with 
finite buffers. In particular, we consider the case that one server speeds-up 
or slows-down when another server is idle or saturated. Finally, we show 
that this approximation scheme also works for other two-node queue with fi¬ 
nite buffer space model, for instance, a coupled-queue with processor sharing 
and finite buffers. The numerical results illustrate that our approximation 
scheme achieves tight bounds. Hence, our method can be useful for quick 
engineering purposes and optimal design of the queueing system. 

The remainder of this paper proceeds as follows. In Section [lj we present 
the model and formulate the research problem. In Section [2j we provide 
an approximation scheme to bound performance measures for any two-node 
queue with finite buffers. We bound performance measures for a tandem 
queue with finite buffers and some variants of this model in Section [3j In 
Section[4| the approximation scheme has also been applied to a coupled-queue 
with processor sharing and finite buffers. Finally, we provide concluding 
remarks in Section [5] 

1. Model and problem formulation 

1.1. Two-node queue with finite buffers 

The two-node queue with finite buffers is a queueing system with two 
servers, each of them having finite storage capacity. If a job arrives at a 
server which does not have any more storage capacity, then the job is lost. 
In general, the two queues influence each other, i.e., the service rate at one 
of the queues depends on the number of jobs at the other. 

Such a queueing system is naturally modeled as a two-dimensional fi¬ 
nite random walk, which we introduce next. The connection between the 
continuous-time queueing system and the discrete-time random walk, ob¬ 
tained through uniformization, is made explicit for various examples in Sec¬ 
tion [3] and Section U 
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1.2. Two-dimensional finite random walk 

We consider a two-dimensional random walk R on S where 

5 1 = {0,1, 2, • • • , Li} x {0,1, 2, • ■ ■ , L 2 }. 

We use a pair of coordinates to represent a state, i.e., for n G S, n — (■ i,j ). 
The state space is naturally partitioned in the following components (see 
Figure [f]): 

C'i = {1,2,3, - - - , Iu — 1} x {0}, C 2 = { 0} x {1,2,3, - - - ,L 2 - 1}, 

C 3 — {1, 2, 3, ■ ■ ■ , Li — 1} x {L 2 }, C 4 = {Li\ x {1,2, 3, • • • ,L 2 — 1}, 

Os = {(0,0)}, C G — {(0, L 2 )}, C 7 — {(L 1; L 2 )}, Cs = {(L 1 , 0)}, 

Cg — {1, 2, 3, • • • ,L!-1} x {1,2,3, ,L 2 -1}. 

We refer to this partition as the C'-partition. The index of the component 
of state n G S is denoted by k(n), i.e., n G Ck( n )- Transitions are restricted 
to the neighboring points (horizontally, vertically and diagonally). For k = 
1, 2, • • ■ , 9, we denote by W the neighbors of a state in Ck- More precisely, 
Ni = {-1, 0,1} x {0,1}, N 2 = {0,1} x {-1, 0,1}, N 3 = {-1, 0,1} x {-1,0}, 
N 4 = {-1, 0} x {-1, 0,1}, N 5 = {0,1} x {0,1}, N 6 = {0,1} x {-1, 0}, N 7 = 
{-1,0} x {-1,0}, Ns = {-1,0} x {1,0} and N 9 = {-1,0,1} x {-1,0,1}. 
Also, let N = Ng. 

Let pk, u denote the transition probability from state n in component k 
to n + u, where u G W- The transition diagram of a two-dimensional fi¬ 
nite random walk can be found in Figure [2j The system is homogeneous 
in the sense that the transition probabilities (incoming and outgoing) are 
translation invariant in each of the components, i.e., 

Pk(n—u),u = Pk(n),u, for n - u G S and u G k(n). (1) 

Equation Q not only implies that the transition probabilities for each part 
of the state space are translation invariant but also ensures that also the 
transition probabilities entering the same component of the state space are 
translation invariant. 

We assume that the random walk R that we consider is aperiodic, ir¬ 
reducible, positive recurrent, and has invariant probability measure m{n), 
where m(n) satisfies for all n G S, 

m(n) = ^2 Pk{n+u),- u m(n + u). 
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1.3. Problem formulation 

Our goal is to approximate the steady-state performance of the random 
walk R. The performance measure of interest is 

T = y ^m(n)F(n), 

n£S 

where F(n) : S — > [0, oo) is linear in each of the components from C'-partition, 
i.e., 

F(n) = /fc(n),o + 1% + fk(n), 23 , for n = (i,j) e S. (2) 

The constants fk( n ), o, fk(n), l and fk(n)p are allowed to be different for different 
components from the C-partition of S. 

In general, it is not possible to obtain the probability measure m(n ) in a 
closed-form. Therefore, we will use a perturbed random walk of which the 
invariant measure has a closed-form expression to approximate the perfor¬ 
mance measure T. 

We approximate the performance measure T in terms of the perturbed 
random walk R. We consider the perturbed random walk R in which only 
the transition probabilities along the boundaries (C\, ■ ■ ■ , Cf) are allowed to 
be different, i.e., for instance, Pi,(_i,o), Pi, (pop Pi,(o,o) f° r the state from C\ 
are allowed to be different in R, p 2 ,(o,ip P 2 ,(o,-ip p 2 ,(o,o) for the state from C 2 
are allowed to be different in R, etc. An example of a perturbed random 
walk R can be found in Figure [ 3 } 

We use pk, u to denote the probability of R jumping from any state n in 
component Ck to n + u , where u G N k . Moreover, let qk )U = Pk,u ~ Pk,u- The 
probability measure fh of R is assumed to be of product-form, i.e., 

fh{n) = ap l a\ 

where n = ( i,j) for some (p,cr) G (0, l) 2 and a 0. The measure m is the 
invariant measure of R, i.e., it satisfies 

fh(n) = ^ p k ( n+u )- u rri(n + u), (3) 


for all n G S. 

I 11 the following sections, we are going to find upper and lower bounds of 
T in terms of the perturbed random walk R defined above. 
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Figure 3: Perturbed random walk R. 

2. Proposed approximation scheme 

In this section, we establish an approximation scheme to find upper and 
lower bounds for performance measures of a two-dimensional finite random 
walk. 

In [8j, an approximation scheme based on a linear program is developed 
for a random walk in the quarter-plane. This approximation scheme has 
also been used in [4], We will show in this paper that the technique can be 
extended to cover our model, i.e., a two-dimensional finite random walk. We 
will explain how this is achieved in the following sections. 

2.1. Markov reward approach to error bounds 

The fact that R and R differ only along the boundaries of S makes it 
possible to obtain the error bounds for the performance measures via the 
Markov reward approach. An introduction to this technique is provided 
in [16j. We interpret F as a reward function, where F{n) is the one step 
reward if the random walk is in state n. We denote by F t (n) the expected 
cumulative reward at time t if the random walk starts from state n at time 
0 , i.e., 


F\n) 


0 , if t = 0, 

F (n) + E ueN k(n) PHn),u Ft ~ l {n + u), if t > 0, 
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For convenience, let F l (n + u) = 0 where u G {(s, t)|s, £ G { — 1,0,1}} if 
n + u (f S. Terms of the form F l (n + u) — F*(n) play a crucial role in the 
Markov reward approach and are denoted as bias terms. Let D* u = F l [n + 
u) — F t (/i). For the unit vectors e\ = (1,0), e 2 = (0,1), let D\[n) = D^fn) 
and -D 2 ( n ) = -^ ) e 2 ( ?7 -)- 

The next result in [TBj provides bounds for the approximation error for T. 
We will use two non-negative functions F and G to bound the performance 
measure T. 

Theorem 1 ( (16]). Let F: S —> [0, oo) and G: S —> [0, oo) satisfy 


F{n) - F(n) + ^ q^^D^n) 


< G(n), 


for all n G S and t > 0. Then 


Ei n n ) — G(n)]m(n) < F < Ei-p( n) + G(n)]m(n). 

n£S n£S 


( 4 ) 

( 5 ) 


2.2. A linear program approach 

In this section we present a linear program approach to bound the errors. 
Due to our construction of R, the random walks R and R differ only in the 
transitions that are along the unit directions, i.e., 


Qk,u — Pk,u ~ Pk,u — 0 for u^{ei,e 2 ,-ei,-e 2 ,(0,0)}. (6) 

This restriction will significantly simplify the presentation of the result. 

To start, consider the following optimization problem. We only consider 
how to obtain the upper bound for T here because the lower bound for T 
can be found similarly. 

Problem 1 

minimize Y^[F(n)+ G(n)]m(n), (7) 

n£S 


F(n) - F(n) + ^ (g fc(n)ies D((n) + q k{n) - es Dl(n - e s )) 

s= 1,2 

< G{n), for n G S,t> 0, 

F(n) > 0, G(n) > 0, for n G S. 
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subject to 


( 8 ) 

( 9 ) 






The variables in Problem 1 are the functions F(n), G{n ) and the parameters 
are F(n),rh(n), qk( n ),e s an d -D*(n) for n G S, s = 1,2. Hence, Problem 1 is a 
linear programming problem over two non-negative variables F{n) and G(n) 
for every n G S. 

This linear program has infinitely many constraints because we have un¬ 
bounded time horizon. We will first bound the bias term H*(n) uniformly 
over t. Then we have a linear program with a finite number of variables and 
constraints. However, further reduction is still needed because the number of 
variables and constraints will increase rapidly if L\ and L 2 , which define the 
size of the state space, increase. Our contribution is to reduce Problem 1 to a 
linear programming problem where the number of variables and constraints 
does not depend on the size of the finite state space. 

We now verify that the objective in Problem 1 is indeed an upper bound 
on the performance measure T. Consider D ^ 0 0 ^(n) = 0, D t _ es {n ) = —Dian¬ 
es) for s = 1,2 and (|6|) , it follows directly that ([8]) is equivalent to Q. 
Therefore, it follows from Theorem [l] that the objective of Problem 1 provides 
an upper bound on T. 


2.3. Bounding the bias terms 

The main difficulty in solving Problem 1 is the unknown bias terms D f s (n). 
It is in general not possible to find closed-form expressions for the bias terms. 
Therefore, we introduce two functions A s : S —» [0, 00 ) and B s : S —>■ [0, 00 ), 
s = 1,2. We will formulate a finite number of constraints on functions A s 
and B s where s — 1,2 such that for any t and s = 1, 2 we have 

- A s (n) < Dl(n ) < B s (n), (10) 


i.e ., , the functions A s and B s provide bounds on the bias terms uniformly 
over all t > 0. In the next section, we will find a finite number of constraints 
that imply (10). Our method is based on the method that was developed 
in [8] for the case of an unbounded state space. 

For notational convenience, as will become clear below, we define a finer 
partition of S, the Z-partition. This partition is depicted in Figure [4j For 
example, we have Z\ = {(0,0)}, Z 2 = {(1,0)}, Z 3 = {2,...,Li — 2}x{0}, 
Z 4 = {(Li —1, 0)} and Z 5 = {(Li, 0)}, the rest of the elements in the partition 
are determined similarly. Let k z (n ) denote the label of component from Z- 
partition of state n £ S, i.e., n G Z^/ n \. Similar to the definition of N k , let 
N k denote the neighbors of a state n in Z k from the Z-partition of S. 
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Figure 4: Z-partition of S with components Z\ : Z 2 , ■ ■ ■ , ^ 25 - 


The constraints which ensure (10) are obtained based on an induction in 


t. More precisely, we express D l s +1 as a linear combination of D\ and D\ as 


D$ + 1 (n) = F(n + e a ) - F(n) + Y 




Cs,k z (n),v,uD v {ri ~\~ u) ) (H) 


l)=l,2 u£N, 


k(n) 


where the c S} k, v ,u, s G {1,2}, A: G {1,2,--- , 25}, u G {l,2},w G N% are con¬ 
stants. An important property of the Z-partition is that starting from any 
state n in component k z of the Z-partition the component k (n + u) in the C- 
partition is well dehned for all u G N | and depends only on k z and u. In [ 8 ] 
it was shown, using this property, that constants c St k, v ,u that ensure ( 11 ) 


always exist and that they can be expressed as simple functions of the tran¬ 
sition probabilities of the random walk. The results in [8] are derived for the 
random walk on the whole quarter-plane. However, a careful inspection of 
the results in PJ reveals that they hold also for our model of a random walk 
on a bounded state space. Therefore, we refer the reader to fSJ and omit 
further details here. 

We are now ready to bound the bias terms based on GD- The result, 
which is easy to verify, states that if A s : S —» [0, 00 ) and B s \ S —> [0, 00 ) 
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where s = 1,2 satisfy 


F(n + e s ) - F(n ) 

+ E E max{ Cs,k z (n),v,uA-s(^Tl "P ^0? Cs,k z (n),v,uFs( K H' ~P ^)} E B s {j}jj^ 

u=i,2ueiv* (n) 


F(n) — F(n + e s ) 

+ E E IliaX | Cs,k z (n),v,uFs {jl Ej j Cs,k z (n),v,u-A s [jl d~ ?/)} E 

v=l,2 u£N~ (n) 

for all n G S', then 

- A a {n) < D\{n ) < B s (n), 
for s = 1, 2, n G S' and t > 0. 

After bounding the bias terms, we are able to rewrite the linear program 
Problem 1 into Problem 2 with a new variables E s (n ) where s = 1,2 and 
n G S'. 

Problem 2 

minimize ^^[F(n) + G(n)]m(n), 

n£S 


subject to 


F(n) - F(n) + ( q k ( n ), es E s (n ) + q k (n)-e s E s (n - e a )) 

s= 1,2 

< G(n), 

- A s (n) < £ s (rc) < 5 s (n), 

F(n + e s ) - F(n) 

+ E E max{ c St k z (n) t v,uA s (ji A n), Cs,k z (n),v,uB "P ri)} 

»= 1 ,2 ueN z ^ n) 

< B s (n), 

F(n ) - F(n + e s ) 

+ E E max| Cs,k z (n),v,uBs(ji “I~ a.), c s ^ k z^ n ^ v ^ u A s {ji G - n)} 

v=i,2 u eiv* (n) 

< A;(n), 

F(n) > 0,G(n) > 0, A,(n) > 0, B s (n) > 0, 
for n G S', s G {1,2}. 
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2-4- Fixed number of variables and constraints 

The final step is to reduce Problem 2 to a linear program with fixed 
number of variables and constraints regardless of the size of the state space. 

We first introduce the notion of a piecewise-linear function on the Z- 
partition. A function F : S —> [0, oo) is called Z-linear if the function is 
linear in each of the components from Z-partition, i.e., 

F(n) = fk z (n)fi + fk z (n ),P + /fc z (n), 2 j 5 f° r n = {h j) £ S. 

where fk z (n), o, fk z (n), 1 and fk z (n ),2 are the constants that define the function. 
In similar fashion we define C-linear functions on the C-partition of S. 

Now, in Problem 2 we put the additional constraint that the variables F, 
G, A s , B s and E s are C'-linear functions. Hence, these functions are defined in 
terms of variables, the number of which is independent on Li and L 2 . Hence, 
the number of variables in the resulting linear program is independent of L\ 
and L 2 . 

It remains to show that the number of constraints is independent of L\ 
and L 2 . Following the reasoning on the properties of Z-partition below ( [TIj ) 
it is easy to see that all constraints in Problem 2 can be formulated as a non¬ 
negativity constraint on a Z-linear function. Such a constraint on a Z-linear 
function induces at most 4 constraints per component in the Z-partition, 
one constraint for each corner of the component. This indicates that the 
number of constraints does not depend on the size of the state space, since 
the number of constraints are fixed as well. 

2.5. The optimal solutions 

We are now able to find the upper and lower bounds of T based on the 
linear program here. 

Let V denote the set of (F, G) for which we are able to find functions A s , 
B s and E s where s = 1,2 such that all constraints in Problem 2 are satisfied. 
Then, we find the upper and lower bounds for T as follow. 



and 



12 



Figure 5: Tandem queue with finite buffers. 


We have now presented the complete approximation scheme to obtain the 
upper and lower bounds for T using the perturbed random walk R of which 
the probability measure is of product-form. 

In the following sections, we will consider two examples: a tandem queue 
with finite buffers and a coupled-queue with processor sharing and finite 
buffers. 

3. Application to the Tandem queue with finite buffers 

In this section, we investigate the applications of the approximation scheme 
proposed in Section [2j 

3.1. Model description 

Consider a two-node tandem queue with Poisson arrivals at rate A. Both 
nodes have a single server. At most a finite number of jobs, say L i and L 2 
jobs, can be present at nodes 1 and 2. This includes the jobs in service. An 
arriving job is rejected if node 1 is saturated, i.e., there are L\ jobs at node 
1. The service time for the jobs at both nodes is exponentially distributed 
with parameters ji\ and /i 2 , respectively. 

When node 2 is saturated, i.e., there are L 2 jobs at node 2, node 1 stops 
serving. When it is not blocked, it instantly routes to node 2. All service 
times are independent. We also assume that the service discipline is first-in 
first-out. 

The tandem queue with finite buffers can be represented by a continuous¬ 
time Markov process whose state space consists of the pairs (i,j) where i 
and j are the number of jobs at node 1 and node 2, respectively. We now 
uniformize this continuous-time Markov process to obtain a discrete-time 
random walk. We assume without loss of generality that A + pL\ + p 2 < 
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Figure 6: Transition diagram of Rt- 

1 and uniformize the continuous-time Markov process with uniformization 
parameter 1. We denote this random walk by Rt- All transition probabilities 
of Rt, except those for the transitions from a state to itself, are illustrated 
in Figure [6] 

3.2. Perturbed random walk of Rt 

We now present a perturbed random walk Rt. The invariant measure of 
the perturbed random walk Rt is of product-form and only the transitions 
along the boundaries in Rt are different from those in Rt- 

In the perturbed random walk Rt, the transition probabilities in the 
components C 3 , C4, Cq, C7, C$ are different from those in Rt- More precisely, 
we have p 3 ,(i,o) = A, p 3 ,(-i,o) = AW At,( 0 , 1 ) = A, p 4 ,(o,-i) = AW see Figure |7[ It 
can be readily verified that the measure, which is of product-form, with a, 
which depends on Li and L 2 as the normalizing constant 



is the probability measure of the perturbed random walk by substitution into 
the global balance equations (J3]) together with the normalization requirement. 

3.3. Bounding the blocking probability 

In this section, we provide error bounds for the blocking probability for 
the tandem queue with finite buffers using our approximation scheme pro¬ 
vided in Section [2] Moreover, we show that our results are better than those 

obtain by van Dijk et al. in ini- 
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Figure 7: Transition diagram of Rt- 

For a given performance measure J c , we use F up , T low to denote the 
upper and lower bounds for T obtained based on our approximation scheme 
and T uv , J- low to denote the upper and lower bounds based on the method 
suggested by van Dijk et ah mi- 

We use Tq to denote the blocking probability, i.e., the probability that 
an arriving job is rejected. We now consider an example that has also been 
considered in mi- 

Example 1. Consider a tandem queue with finite buffers, we have A = 0.1, 

Pi = 0.2, /io = 0.2. 

We would like to compute the blocking probability of the queueing system. 
Hence, for the performance measure function F(n), defined in (J2|, we set 
the coefficients fk,d where with k = 1,2, ,9, d = 1,2,3 to be fs,i = 1, 

/ 41 = 1, / 7jl = 1 and others 0. The error bounds can be found in Figure [8} 
Clearly, our results outperform the error bounds obtained in HZ]. Moreover, 
the difference between the upper and lower bounds of J r 0 are captured in 
Figure [9] This indicates that our error bounds are tighter than those in Pf 

In addition to the improved bounds, there is another advantage to our 
method. There is a limitation to the model modification approach that is 
used in HZ]. This method requires a different model modification for each 
specific performance measure. For instance, the specific model modifications 
which are used to find error bounds for the blocking probability of a tandem 
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Example 


A = 0.1 

Hi = 0.2 

/12 = 0.2 

L\ = L 2 



Figure 8: The blocking probability Tq. 


Example 


A = 0.1 

/i! = 0.2 
/i2 = 0.2 
L 1 = L 2 



Figure 9 : The difference between bounds of J~q. 
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queue with finite buffers in m cannot be used to obtain error bounds for 
the average number of jobs in the first node. In addition, extra effort is 
needed to verify that the model modifications are indeed valid for a specific 
performance measure. In the next section, we will show that our method can 
easily provide error bounds for other performance measures without extra 
effort. 


3-4- Bounds for other performance measures 

In this section, we will demonstrate the error bounds for other perfor¬ 
mance measures for Example [lj i.e., a tandem queue with finite buffers. 

Let T\ be the average number of jobs at node 1 and Ti which is the 
average number of jobs at node 2. 

In general, the models, (he., the perturbed systems), used to bound the 
blocking probability in m cannot be used to bound T\ and JL. The method 
in nzi requires different upper and lower bound models for different perfor¬ 
mance measures. Moreover, this method also requires effort to verify that 
they are indeed the upper and lower bound models for this specific perfor¬ 
mance measure. Our approximation scheme does not have this disadvantage. 
For different performance measure, we only need to change the coefficients 
ff : d where k = 1, 2, • • • ,9 and d — 1, 2, 3 in F(n), which is defined in (J2]). 

It can be readily verified that the performance measure T is J-\ if and 
only if we assign following values to the coefficients: /i )2 = 1, /s ,2 = 1, / 9,2 = 
1, / 4,2 = 1, / 3,2 = 1, ,/V .2 = 1 and others 0. Figure [T0| presents the error bounds 
of T\. Similarly, the performance measure J- is Ti if and only if we assign 
following values to the coefficients: / 2 , 3 = 1, / 9 , 3 = 1, h ,3 = 1, fe ,3 = 1, /. 3,3 = 
1, / 7)3 = 1 and others 0. Figure 11 presents the error bounds of J r 2 . 

The results show that tight bounds have been achieved with our approx¬ 
imation scheme. Moreover, the only thing we need to change for different 
performance measures is the input function, which does not require further 
model modifications. In the next section, we will show that our approxima¬ 
tion scheme could also give error bounds for the performance measures of the 
tandem queue with finite buffers which has a slower or faster server when 
another node is idle or saturated, respectively, without model modifications 
as well. 


3.5. Tandem queue with finite buffers and server slow-down/speed-up 

In this section, we consider two variants of the tandem queue with finite 
buffers. More specifically, we provide error bounds for the blocking proba- 
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Size of the finite buffers 


Figure 10: Average number of jobs at node 1, T\. 


Example 
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Figure 11: Average number of jobs at node 2, T 2 - 
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bilities when one server in the tandem with finite buffers is slower or faster 
if another node is idle or saturated, respectively. 


3.5.1. Tandem queue with finite buffers and server slow-down 

Tandem queue with server slow-down has been previously studied in, 
for instance, [SI HD]- A specific type of tandem queue with finite buffers 
and server slow-down has been considered in ED [ID]. More precisely, the 
service speed of node 1 is reduced as soon as the number of jobs in node 
2 reaches some pre-specified threshold because of some sort of protection 
against frequent overflows. 

We consider a different scenario with server slow-down. In our case, the 
service rate at node 2 reduces when node 1 is idle. This comes from a 
practical situation that when node 1 is idle, the working pressure for node 
2 decreases and can shift some working capacity to other tasks. Therefore, 
we consider a two-node tandem queue with Poisson arrivals at rate A. Both 
nodes have a single server. At most a finite number of jobs, say Li and 
L 2 jobs, can be present at nodes 1 and 2, respectively. An arriving job is 
rejected if node 1 is saturated. The service time for the jobs at both nodes 
are exponentially distributed with parameters /q and /i 2 , respectively. While 
node 2 is saturated, node 1 stops serving. When it is not blocked, it instantly 
routes to node 2. While node 1 is idle, the service rate of node 2 becomes /i 2 
where < h 2 - All service times are independent. We also assume that the 
service discipline is first-in first-out. 

The tandem queue with finite buffers and server slow-down can be rep¬ 
resented by a continuous-time Markov process whose state space consists of 
the pairs (i, j) where i and j are the number of jobs at node 1 and node 
2 , respectively. We assume without loss of generality that A + /q + p 2 < 1 
and uniformize this continuous-time Markov process with uniformization pa¬ 
rameter 1. Then we obtain a discrete-time random walk. We denote this 
random walk by Rff, all transition probabilities of Rff, except those for the 
transitions from a state to itself, are illustrated in Figure [12} 


It can be readily verified that the random walk Rt as defined in Section 3.2 
is a perturbed random walk of Rff as well, i.e., the transition probabilities 


T 

?sd 


in Rt only differ from those in Rff along the boundaries. We next consider 
a numerical example. 


Example 2 (slow-down). Consider a tandem queue with finite buffers and 
server slow-down, we have A = 0.1, pi = 0.2, p 2 = 0.2 and fi 2 = 0.5/i 2 . 
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Figure 12: Tandem queue with server slow-down and blocking. 
•1(T 2 
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Figure 13: Blocking probability with server slow down. 


The error bounds for the blocking probability of Example [2] are illustrated 


in Figure 13 


Notice that our approximation scheme is sufficiently general in the sense 
that the error bounds for the performance measures of all tandem queue with 
server slow-down and blocking mentioned in the previous paragraphs can be 
obtained with our approximation scheme. There are no restrictions on the 
input random walk. 


3.5.2. Tandem queue with finite buffers and server speed-up 

It is also of great interest to consider a tandem queue with finite buffers 
and server speed-up. 
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Figure 14: Tandem queue with finite buffers and server speed-up. 


We consider the following scenario with server speed-up: The service rate 
at node 2 increases when node 1 is saturated. This comes from a practical 
situation, for instance, when node 1 is saturated, the working pressure for 
node 2 increases to eliminate the jobs in the queueing system. Therefore, 
we consider a two-node tandem queue with Poisson arrivals at rate A. Both 
nodes have a single server. At most a finite number of jobs, say L\ and 
L 2 jobs, can be present at nodes 1 and 2, respectively. An arriving job 
is rejected if node 1 is saturated. The service time for the jobs at both 
nodes are exponential distributed with parameters ji\ and /i 2 , respectively. 
When node 2 is saturated, node 1 stops serving. When it is not blocked, 
it instantly routes to node 2. When node 1 is saturated, the service rate of 
node 2 becomes Jl 2 where ji 2 > )i 2 . All service times are independent. We 
also assume that the service discipline is first-in first-out. 

Tandem queue with finite buffers and server speed-up can be represented 
by a continuous-time Markov process whose state space consists of the pairs 
(i, j ) where i and j are the number of jobs at node 1 and node 2, respectively. 
We assume without loss of generality that X + /j,i+fi 2 < 1 and uniformize this 
continuous-time Markov process with uniformization parameter 1. Then we 
obtain a discrete-time random walk. We denote this random walk by Aft, all 
transition probabilities of Aft, except those for the transitions from a state 


to itself, are illustrated in Figure 14 


Again, it can be readily verified that the random walk Ay as defined in 


Section 3.2 is a perturbed random walk of Aft' because only the transitions 


along the boundaries in Ay are different from those in Aft. We next consider 
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Figure 15: Blocking probability with server speed-up. 


the following numerical example. 


Example 3 (speed-up). Consider a tandem queue with finite buffers and 
server speed-up, we have A = 0.1, /q = 0.2, /i 2 = 0.2 and /i 2 = 1.2/x 2 . 


The error bounds for the blocking probability of Example [3] can be found 


in Figure 15 


Until now, we have focused on the tandem queue with finite buffers model. 
In fact, our approximation scheme has been constructed in such a manner 
that it can be applied to any two-node queueing system with finite buffers. 
In the next section, we will study a different two-node queueing system with 
finite buffers and obtain error bounds for some performance measures. 


4. Application to the coupled-queue with processor sharing and 

finite buffers 

In this section, we apply the approximation scheme to a coupled-queue 
with processor sharing and finite buffers. Two coupled processors problem 
has been extensively studied so far. In particular, Fayollc et al. reduce 
the problem of finding the generating function of the invariant measure to 
a Riemann-Hilbert problem in (5|. However, when we have finite buffers, in 
general, the methods developed for a coupled-queue with infinite buffers are 
no longer valid. 
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Figure 16: Coupled-queue with processor sharing and finite buffers. 


J h l. Model description 

Consider a two-node queue with Poisson arrivals at rate Ai for node 1 and 
A 2 for node 2. Both nodes have a single server and at most L x and L 2 jobs 
can be present at nodes 1 and 2, respectively. When neither of the queues 
is saturated they evolve independently, but when one becomes saturated the 
service rate in the other changes. An arriving job for node 1 is rejected 
when node 1 is saturated. Similarly, an arriving job for node 2 is rejected 
when node 2 is saturated. The service time at both nodes is exponentially 
distributed with parameters /q and /r 2 , respectively, when neither of the 
nodes is saturated. When node 1 is saturated, the service rate at node 2 
becomes /A where /A > /i 2 and when node 2 is saturated, the service rate at 
node 1 becomes /A where /A > pL\. All service requirements are independent. 
We also assume that the service discipline is first-in first-out. 

This coupled-queue with processor sharing and finite buffers can be rep¬ 
resented by a continuous-time Markov process whose state space consists of 
the pairs (i,j) where i and j are the number of jobs at node 1 and node 2, 
respectively. We assume without loss of generality that Ai + A 2 + /A + /A < 1 
and uniformize this continuous-time Markov process with uniformization pa¬ 
rameter 1. Then we obtain a discrete-time random walk. We denote this 
random walk by Rc■ All transition probabilities of Re, except those for the 


transitions from a state to itself, are illustrated in Figure 16 
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Figure 17: Transition diagram of the perturbed random walk Rc- 


4-2. Perturbed random walk Rc 

We now display a perturbed random walk R c of Rc such that the prob¬ 
ability measure of Rc is of product-form and only the transitions along the 
boundaries in Rc are different from those in Re¬ 
in the perturbed random walk Rc, the transition probabilities in com¬ 
ponents C 3 , C 4 , Cq, Cj, C$ are different from that in Rc- More precisely, we 


have Pi,(i,o) — -^i ; Pi,(-i,o) — R>i, P 2 ,(o,i) — ^2 
P 3 ,(-i,o) = Ri, P 4 ,(o,i) = A 2 , P 4 ,(o,-i) = R 2 , see Figure [T7 


P 2 ,( 0 ,-l) — R2, P 3 ,(l, 0 ) — Ai, 

ft can be readily 


verified that the measure, which is of product-form, with a, which depends 
on L\ and L 2 as the normalizing constant 


m{n ) 



where n—{i,j ), 


is the probability measure of the perturbed random walk by substitution into 
the global balance equations ([3]) together with the normalization requirement. 

We next illustrate a numerical example of a coupled-queue with processor 
sharing and finite buffers. 


4-3. Numerical results 

Example 4. Consider a coupled-queue with processor sharing and finite buffers, 
we have X\ = X 2 = 0.1 ,Ri — H 2 — 0.2, fi\ = 0.4, fi- 2 = 0.3. 
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Size of the finite buffers 
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Ai — A 2 — 0.1 

P>i — P -2 — 0.2 

L\ — L 2 


P 1 = 0.4 


p >2 = 0.3 



Figure 18: Average number of jobs at node 1, T\. 


For Example [4j the error bounds for the average number of jobs at node 1 
can be found in Figure [18] This result also indicates that our approximation 
is quite general in the sense that it can be used to find the performance 
measure of another two-node queue with finite buffers, as, for example, a 
coupled-queue with processor sharing and finite buffers. 

5. Conclusion 

In this paper, we presented a generalized approximation scheme for a two- 
node queue with finite buffers that establishes error bounds for a large class of 
performance measures. Our work is an extension of the linear programming 
approach developed in [S] to approximate performance measures of random 
walks in the quarter-plane. We applied our approximation scheme to obtain 
bounds for performance measures of a tandem queue with finite buffers and 
some variants of this model. Then, we applied our approximation scheme to a 
coupled-queue with processor sharing and finite buffers. The approximation 
scheme gives tight bounds for various performance measures, like the blocking 
probability and the average number of jobs at node 1. 
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